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Leveraging  Process  Knowledge  to  Improve 
Modeling  of  Evaporation  Rate  Data  for 
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Purpose  df  Talk 

•  Demonstrate  how  the  modeling  (regression  analysis) 
of  evaporation  rate  data  can  be  improved  by  rescaling 
the  variables  based  on  knowledge  of  the  process 

•  Describe  how  running  the  experimental  design  trials 
in  specific  randomized  blocks  -  as  compared  to 
running  the  planned  trials  in  a  haphazard  order  - 
facilitates: 

O  A  sequential  nno(del  building  process 

O  Identifying  when  running  more  trials  adds  little  new  information 
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•  Rescaling  the  variables  using  knowledge  of  the 
physics  reduces  the  complexity  of  the  model 
required  to  adequately  fit  the  data 

O  Before  rescaling,  a  10-term  quadratic  model  was  needed 

O  After  rescaling,  a  4-term  linear  model  is  all  that  is  needed 

•  Extrapolated  predictions  for  checkpoints  within  the 
5-cm  tunnel  data  validate  “nearby”  extrapolation 
with  the  physics-based  linear  model 

•  For  the  physics-based  linear  model  “farther  out” 
extrapolations  are  more  plausible  than  those  of  the 
empirical  model. 

O  Note  that  these  “farther  out”  conditions  are  beyond  the  practical  range  of  the 
wind  tunnels  and  that  these  predictions  have  not  been  validated. 
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•  Although  the  same  level  of  reduction  of  the  number 
of  required  trials  seen  for  HD  on  glass  may  not  hold 
true  for  other  agents  and/or  substrates,  results  point 
to  importance  of  running  trials  in  a  sequence  of 
blocks  that  support  increasingly  complex  models. 

•  Combining  the  data  for  the  5-cm  and  10-cm  tunnels 
shows  that  the  “tunnel  effect”  -  although  statistically 
significant  -  is  dwarfed  by  the  effects  of  the 
Temperature,  Wind  Velocity  and  Drop  Size  which  are 
5X  to  14X  as  large.  For  HD  on  glass,  the  behavior  of 
the  two  tunnels  appears  quite  similar. 
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-  jiata^oriHD 
Cam^^rom^^o  Sources 


•  5-cm  ECBC  tunnel  data 

O  19  unique  trials  -  with  one  observation  for  each  -  i.e.  no  replicates 

•  10-cm  Czech  tunnel  data 

O  13  unique  trials  with  34  observations  -  eight  2X,  four  3X  and  one  6X 

•  In  both  cases  the  original  plan  called  for  the 
running  of  a  “vaiidation  design”  -  27  unique  triais 
making  up  the  3X3X3  fuii-factoriai  design 
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_  rial  Design  and 

pineal  iviodel^^rms  It  ban  Support 


y  =  +  djXj^  +  32X2  +  33X3  constant  +  linear 

+  dL^^2  ^13^1^3  +  ^2^^3  +  2-way  interactions 

+  a^jX/  +  322X2^  +  933X3^  +  curvature  terms 

+  +  3-way  interaction 

+  a^^^X2  +  a^2^^^  +  a^^^^x^  +  partial  cubic  terms 

+  a^2i^^3  '*'  ^22^2^3  '*'  ^232^^3^ 


Because  this  design  does  not  have  4  levels/variable,  it  cannot 
be  used  to  fit  full  cubic  terms  such  as  ^22^2 
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II  I  r  J  UNGLASSIFIED/UNLIMITED 

Comparing  Surfaces'  for  Increasingly  Complex 
Po)3nfpT|»i^1s|f  it~t|o  Da^a  ifrom  the  Branin  Function 


60() 


Linear 

y  =  ao  +  +  82X2 


4(M) 


60(1  Partial  Cubic 
y  =  Quadratic 

4(X)  +  a  2  9 122^  1^2^ 


600 

40t) 


Interaction 
y  =  Linear  +  a  ^2^  1^2 


600 

40() 


Quadratic 
y  =  Interaction 


+  a^^x/  +  a^oX 


22^2 


^0 


6(X)  Full  Cubic 
y  =  Partial  Cubic 

400  a^yyXy^  ^  ^22^^ 2^ 


“Branin  Function” 


lu 


I'lGURE  C.L  The  Branin  function  on  [-5, 10]  x  (Ot  15| 


Of  these  models,  the  full  cubic  best  approximates  the  Branin  function, 
but  still  cannot  represent  the  ripples  visible  on  edges  of  the  last  plot. 
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•  Remedy  for  lack  of  fit 

•  Plot  predictions  wiii  not  vioiate  physicai  iimits 

e.g.  “#  of  Counts”  not  negative; 

YIELD  not  >  100% 

•  Make  model  more  robust 

•  Make  error  more  uniform  across  design  region 
(also  called  “stabilizing  the  variance”) 

O  Transformations  change  the  scale  of  the  response  to  make  it  more  nearly 
conform  to  the  usual  regression  assumptions,  the  most  important  of  which 
are  that  the  data  are  independent  and  follow  a  normal  distribution  with  a 
constant  variance. 


UNCLASSIFIED/UNLIMITED 


9 


Does  not  require  additional  trials. 


Usually  requires  additional  trials. 
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are  Virtually  Same 

iyithin  thb  R4n^ 

fe  of  the  Control 

Variable  Settings  (100  to  400) 


RATE 

At  Rate  =  500  At  Rate  =  500 

Predicted  Yield  is  4  Predicted  Yield  is  22 

Which  prediction  is  more  suspect?  Why? 
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'^€>#1  tojuke  a  T ransformation- 
Forced  Eliminate  Lack-of-Fit 


•  Consult  a  book  like 

•  Check  publications  in  your 
fieid  to  see  how  others 
present  the  same  kind  of  data. 

•  Consuit  your  iocai  statisticai 
expert. 


OXFOIU3  STA nSTICAL  SEJiiKS  -  1 

Plots,  Transformations 
and  Regression 

An  Introduction  to 
Graphical  Methods  of 
Diagnostic  Regression 
Analysis 

A.  C.  ATKINSON 


OXFORD  SCIENCE  PUBLICATIONS 
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-j _ _ _ w _ unclassified/unlimited 

^ample^f-now  Rescaling 
ivial^e^  ihe^^alysis  Easier 


Specific  Heat  of  Metais  for  T  <  lO^K 


C  =  Kr  +  )8P 


C/T=y  +  PT^ 

OT  vs.  T'^ 


TA2 
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•  Evaporation  rate  and  temperature  have  an  Arrhenius 

relationship  where  Evap_Rate  is  proportional  to  which 

leads  to  the  scaling  choices  of  taking 

O  the  log^o  of  the  response,  Evaporation  Rate,  (log^  could  have  been  used)  and 

O  the  inverse  of  the  control  variable  Temperature  (in  °K) 

•  From  Prof.  J.  Danberg  via  M.  Miller  -  evaporation  rate  is 
proportional  to  the  cube-root  of  the  Wind  Velocity 

•  Believing  that  evaporation  rate  was  dependent  on  the  area 
of  the  drop  led  to  assumption  that  response  should  be 
proportional  to  square-root  of  the  Drop  Size. 

O  Recently  T.  D’Onofrio  pointed  out  that  drop  size  is  really  a  volume  and 
therefore  the  calculated  area  of  the  drops  is  proportional  to  (Drop  S\ze)^'^. 

It  will  be  shown  that  reanalysis  of  the  data  using  this  new  scaling  makes  for 
very  minor  changes  in  predictions  and  no  altering  of  original  conclusions. 
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constant  +  linear 
+  2-way  interactions 
+  curvature  terms 

The  quadratic  model  can  support  many  shapes  -  including; 
mountain,  valley,  ridge,  saddle  and  plane. 


loQiofyJ  =  ao  +  +  82X2  +  83X3 

^  ^  ^  ^23^2^3 

+  ajjXj^  +  822X2^  +  833X3^ 


constant  +  linear  terms 

sample  exponents  used 
to  “linearize”  model 

The  linear  model  can  only  support  a  plane. 


lOQiofyJ  ”  ^0  A2X2  + 

and  X,  =  (xj-^,  X2  =  X3  = 
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SORT  of  Drop  Size 


AJNLIMITED 


ications-of^e  19  Unique  Trial 

HI  I  i  '  ■ 

Settings  for-tlie  5-cni  Tunnel 


8  extreme  (corner)  points 

4  internal  points  on  hi  T  (low  1/T)  front  face 

5  internal  points  on  intermediate  T  slice 

2  internal  points  on  low  T  (hi  1/T)  back  face 


Red  lines  indicate  the 
area  on  each  slice  of  1/T 
enclosed  by  the  shaded 
(internal)  points 
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•  Good  news;  Physics-based  linearized  model  fits 
well  -  has  slightly  smaller  model  error  (residual  std. 
dev.)  and  higher  Adjusted-R^  than  empirical  model 

•  Better  news;  Interpolated  vcxo^eX  predictions  based 
on  fitting  data  at  8  corner  design  points  are 
validated  by  data  at  locations  of  1 1  interior  design 
trials  -  which  were  not  used  in  fitting  model 

e  Even  better  news;  Reversing  the  situation,  the 
extrapolated  model  predictions  based  on  fitting 
data  at  1 1  interior  points  are  validated  by  data  at  8 
corners  -  which  were  not  used  in  fitting  model 

e  Maybe  best  news;  As  few  as  4  corner  points  +  1 
center  point  are  needed  for  the  80%  solution... 
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Iriterpolatioh  ^ 

I  {Riespohs 


ith  E^i 
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irical  Quadratic  Model 


T  (Evap_Rate_(copy)) 


Temp  (deg  C)  =  35 
Drop  Size 


'ransformed  to  Lbg^o  Scale) 


T  (Evap_Rate_(copy)) 

Temp  (deg  C)  =  35.0 


Velocity_(nn/s) 

T  (Evap_Rate_(copy)) 


1-D,  2-D  &  3-D  plots  of  Evap_Rate 
vs.  Velocity  and  Drop_Size 
with  Log.|o  transformation  “applied” 


T  (Evap_Rate_(copy)) 


All  19  trials  fit  using  a  10-term 
quadratic  model 

101.38  =  24.0 


Velocity_(m/s) 

Velocity=1.23 

Drop_Siz=4.00 

Value 

Plot  SD 

Predicted  SD 

1.38 

0.04 

0.09 

Temp  (deg_C)  = 

Drop  Size  (ul)  = 
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Velocity_(m/s) 


=i 

_ _ _ _ J _ UNCLASSIFIED^UNLimTED 

nterpolatipn  with  Empirical  Model 

:es 

l^nse  Vr^n^forme^  Badk  to  Original  Scale) 

Eva  p_Rate_(co  py ) 


xtr^p 

espAnse 


Eva  p_Rate_(co  py ) 


olatio 


ZUWLIMITED 

tjpn^jtn  Empirical  Model 

nsfomiea  Back  to  Original  Scale) 


Evap_Rate_(copy) 

Temp  (deg  C)  =  35. C 


151 


1QI 


Velocity_(m/s) 


Temp  (deg  C)  =  35. ( 


Eva  p_Rate_(co  py ) 


All  19  trials  fit  using  a  10-term 
quadratic  model 

Predicted  Evap_Rate 
At  8  m/s  =  1.3  (0.1,  17.1) 


Velocity=8.00 

Drop_Siz=1.00 

Value 

Low  Limit 

High  Limit 

1.33 

0.10 

17.11 

JNCLASSIFIED/UNLIMITED 


Velocity_(m/s) 


SORT  of  Drop  Size 


i 

i 

-1 

fi^eri 

le 

t 

or 

tI 

rials-fo^ 

hly 

’-ch( 

the  11  Unique 
i  5-cm  Tunnel 

The  red  polyhedral  shape 
results  from  “shrink  wrapping” 
the  1 1  non-corner  design  trials 
for  the  5-cm  tunnel. 

Predictions  at  the  8  corners  of 
the  design  region  made  using  a 
modei  fit  to  these  1 1  points  are 
extrapolated  predictions. 
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0Z!S  dojQ  lidOS 


p|edictioiis 

UNCLASSIFIED/UNLIMITED 

on  Raw  and  Transformed 

'  Scales  at  I 

Location  of  the  Poorest 

Performing 

Extrapolated  Checkpoint 

Evap_Rate_(copy)  T  (Evap_Rate_(copy)) 


Cube-root_of_Vel 


Cube-roo=0.60 

SQRT_Dro=1.00 

Value 

Low  Limit 

High  Limit 

16.88 

10.10 

28.20 

Predicted  value  is  16.88  on  raw  scale 
with  95%  Prediction  Limits  of  10.10  to  28.20 
Observed  value  was  21.6  on  raw  scale 


Observed  Log.,o(21.6)  =  1.33 


Cube-root_of_Vel 

Cube-roo=0.60  SQRT_Dro=1 .00 

Value  Plot  SD  Predicted  SD 

1.23 _ 007 _ Oil _ 

Predicted  value  is  1.23  on  loglO  scale 
Within  one  Predicted  SD  (0.11)  of  the 
Observed  value  of  1.33  on  loglO  scale 

Predicted  10^23  =  ie.98 
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SQRT_Drop_Size 


^t^ri^o^aticin 

^ _ I  UNCLASSIFip/UJ 

w/Phyjsics- 

SILIMITED_ 

■Biased  Linear  Model 

(Respo^s 

e  'i'ranslfol'm 

-  ‘ ^ - i — 

ed  to  Log.|o  Scale) 

T  (Evap_Rate_(copy)) 


Inverse 

SORT 


Cube-root_of_Vel 

T  (Evap_Rate_(copy)) 


T(Evap_Rate_(copy)) 

Inverse  Temp  =  0.00324 


1-D,  2-D  &  3-D  plots  of  Evap_Rate  vs. 
Cube-root_of_Vel  &  SQRT_Drop_Size 
With  Log.,0  transformation  “applied” 


T  (Evap_Rate_(copy)) 


o 

\  ^ 

„  ^■0  .  \|e^ 

GO'O®'' 


1 1  interior  trials  fit  using  a 
4-ternn  linear  model  that  is 
physics  based 

101  40  -  25-1 


lnverse_Temp  =  0.00324' 
SORT  Drop  Size  =  1 .00( 


Cube-root_of_Vel 

Cube-roo=1.07 

Value  Plot  SD 

1.40  0.03 


SQRT_Dro=2.00 
Predicted  SD 
0.08 


UNCLASSIFIED/UNLIMITED 


Cube-root_of_Vel 


23 


Term 


II  I _ I _ ^  UNCLASSIFI^D/UNLIMITED 

!  Comparis^i)  of  Ranked  ^ffect  Estimates 
I  fbr  1 0-teijm  Quadratic  Models  Fit  to 
Unscaied  aiid  Scaied  Control  Variables 


Pareto  Effects  for  logio(Evap_Rate)  Pareto  Effects  for  logio(Evap_Rate) 


0.0  0.2  0.4  0.6  0.8  1.0  1.2 


Effect 


1  Tennp_(deg_C) 

3  Velocity_(nn/s) 

2  Drop_Size_(ul) 

9  Velocity_(nn/s)''2 
8  Drop_Size_(ul)''2 

6  Drop_Size_(ul)*Velocity_(m/s) 

4  Tennp_(deg_C)*Drop_Size_(ul) 

5  Tennp_(deg_C)*Velocity_(nn/s) 

7  Tennp_(deg_C)''2 


hH 

h-H 

h-H 

These  6  terms 
eliminated  — ^ 

Only  #6  close 
to  being 
significant 


0.0  0.2  0.4  0.6  0.8  1.0  1. 

Effect 


lnverse_Tennp 

Cube-root_of_Vel 

SQRT_Drop_Size 

SQRT_Drop_Size*Cube-root_of_Vel 
Cu  be-root_of_Vel''2 
SQRT_Drop_Size''2 
I  nverse_Temp*Cube-root_of_Vel 
lnverse_Tennp''2 

lnverse_Temp*SQRT_Drop_Size 


An  Effect  is  the  Change  in  the  Response,  log^o(Evap_Rate), 
Resulting  from  Changing  a  Variable  Setting  from  Low  to  High 
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Udrhparisoii 

1  i 

IVIodel  Error  Estimates 

Quadratic  Model  without 
rescaling  of  control  variables 


Linear  Model  with 

rescaling  of  control  variables 


N  trials  =  19 

N  terms  =  10 

Residual  DF  =  9 

Residual  SD  =  0.0782 

Cross  val  RMS  =  0.1061 

R  Squared  =  0.992 

Adj  R  Squared  =  0 . 983 


N  trials 
N  terms 
Residual  DF 
Residual  SD 

Cross  val  RMS 

R  Squared 
Adj  R  Squared 


=  19 
=  4 
=  15 
0.0700 

0.0778 

0.989 

0.986 


Results  are  similar  but  slightly 
better  for  the  4-term  linear  model 
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Evaporation  Rate  (pg/min) 


i 

c 

_ _  _  r  UNCLASSIFIED/UMLIMITED 

ompai;ing  Residual  SD,  Checkpoint  RMS 

i 

1 

a 

pd  Raw  Sp  fdr  a  Si 

nple  Control  Variable 

(NOTE:  Real  Data  NOT  Used  in  this  Comparison) 


N  trials 
N  terms 
Residual  DF 
Residual  SD 
(Model  error) 


=  11 
=  2 
=  9 

=  0.0655 


N  checkpoints  =  12 
Checkpoint  RMS  =  0.0808 
(Prediction  error) 


Raw  SD  =  0.2245 

(Error  about  mean  of  data 
for  11  trials  used  to  fit) 


Graph  paper  used  has  log^o  vertical  scale  and  cube-root  horizontal  scale. 
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/UN 

Co^paringJ^esidual  SD, 
Checkboint^lVI^  and  Raw  SD 


•  When  Residual  SD  ~  Checkpoint  RMS  then 
model  error  is  comparable  to  prediction  error 

O  Residual  SD  calculated  from  the  differences  between  the  observed  and  fitted 
(predicted)  values 

O  Checkpoint  RMS  calculated  from  the  differences  between  the  observed  and 
predicted  values  -  BUT  the  observed  values  were  NOT  used  to  fit  the  model 
used  to  make  the  predictions 

•  Ideally  both  Residual  SD  and  Checkpoint  RMS  should 
be  “far”  from  Raw  SD  (SD  about  the  Mean  of  the  data) 

O  There  is  no  statistical  test  for  how  far  apart  they  should  be,  but  for  the  closer 
case  -  the  fitting  of  the  1 1  internal  points  -  the  Raw  SD  (0.4923)  is  6  times 
larger  than  both  the  Checkpoint  RMS  (0.0765)  and  the  Residual  SD  (0.0785) 
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1 
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rison  of 

L  I 

SILIM,ITED 

Model  Error 
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1 

1 

>oint  Err 

I 

oil  for  8  Corners 

and  11  Internal  Points 

Fit  of  8  Corner  Points  and 
Use  11  Internal  as  Checkpoints 


N  trials  =  8 

N  terms  =  4 

Residual  DF  =  4 
Residual  SD  =  0.0633 
Raw  SD  =  0.7332 

N  checkpoints  =  11 
Checkpoint  RMS  =  0.0816 
Cross  val  RMS  =  0.0895 

R  Squared  =  0.996 

Adj  R  Squared  =  0.993 


Fit  of  11  Internal  Points  and 
Use  8  Corners  as  Checkpoints 


N  trials  =  11 

N  terms  =  4 

Residual  DF  =  7 
Residual  SD  =  0.0785 
Raw  SD  =  0.4923 

N  checkpoints  =  8 
Checkpoint  RMS  =  0.0765 
Cross  val  RMS  =  0.1067 

R  Squared  =  0 . 982 

Adj  R  Squared  =  0.975 


Residual  SD  and  Checkpoint  RMS  Values  Agree  Well 
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_  I  I  J  I  IIMni  ASSIFIPn/IIMI  IMITFn 

_  Comparison  of  Checkpoint  RMS  for 
IVP  ternr|  (ieft)  'vs.  term  (right) 
Fitting  SCorners  w/1  Internai  Checkpoints 


Fit  of  8  Corner  Points  and 
Use  11  Internal  as  Checkpoints 


N  trials 

= 

8 

N  terms 

4 

Residual  DF 

4 

Residual  SD 

0.0633 

Raw  SD 

— 

0.7332 

N  checkpoints 

11 

Checkpoint  RMS 

= 

0.0816 

Cross  val  RMS 

0.0895 

R  Squared 

0.996 

Adj  R  Squared 

= 

0.993 

Fit  of  8  Corner  Points  and 
Use  11  Internal  as  Checkpoints 


N  trials 

= 

8 

N  terms 

4 

Residual  DF 

4 

Residual  SD 

0.0633 

Raw  SD 

— 

0.7332 

N  checkpoints 

11 

Checkpoint  RMS 

0.1117 

Cross  val  RMS 

= 

0.0895 

R  Squared 

0.996 

Adj  R  Squared 

= 

0.993 

Checkpoint  RMS  Better  with  than  with 
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eckpoint  RMS  for 


_ompa  ___  _  _  , _ 

te^n^  {ieit)  term  (right) 


Fitting  1 1  Internai  w/8  Corner  Checkpoints 


Fit  of  11  Internal  Points  and 
Use  8  Corners  as  Checkpoints 


N  trials 

— 

11 

N  terms 

4 

Residual  DF 

7 

Residual  SD 

0.0785 

Raw  SD 

— 

0.4923 

N  checkpoints 

8 

Checkpoint  RMS 

— 

0.0765 

Cross  val  RMS 

0.1067 

R  Squared 

0.982 

Adj  R  Squared 

0.975 

Fit  of  11  Internal  Points  and 
Use  8  Corners  as  Checkpoints 


N  trials 

— 

11 

N  terms 

4 

Residual  DF 

7 

Residual  SD 

0.0776 

Raw  SD 

— 

0.4923 

N  checkpoints 

8 

Checkpoint  RMS 

0.0857 

Cross  val  RMS 

= 

0.1062 

R  Squared 

0.983 

Adj  R  Squared 

= 

0.975 

Checkpoint  RMS  Better  with  than  with 
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Cube-root  of  Vel  Cube-root  of  Vel 


L_l _ ^ ^ ^ ^ ^ _ Z _ I  [JNni  AS.SIFIFn/liNI  IMITFn  I 

i 

( 

npare 

Idictioks 

for 
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Models  Using 

- j 

I 

i 

i 

Ti 

\RI 

Lbrbp  vk. 

S( 

_Drop_Size 

T  (Evap_Rate_(copy))  Evap_Rate_(copy) 


> 

m 

,> 

Dro=12.67 

Cube-roo=1.53 

Value 

Plot  SD 

Predicted  SD 

1.83  0.05 

0.09 

AREA_Drop 


T  (Evap_Rate_(copy)) 


InverseTemp  = 


SQRT_Dro=2.45 
Value  Low  Limit 

69.54  44.88 


SQRT_Drop_Size 


Cube-roo=1.53 
High  Limit 
107.74 


SQRT_ 

Value 


.Dro=2.45 

1.84 


Plot  SD 

0.05 


Cube-roo=1.53 
Predicted  SD 
0.09 


150 


100 


Evap_Rate_(copy) 


SQRT_Drop_Size 
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SQRT_Drop_Size 


ZUNLIMITED 


ri^okaticin^jpjiyisics  -Based  Linear  Model 

expense  Trankforjned  Back  to  Original  Scale) 


Evap_Rate_(copy) 


15( 


10() 


In  vers 


Evap_Rate_(copy) 

Inverse  Temp  =  0.00324 


1-D,  2-D  &  3-D  plots  of  Evap_Rate  vs. 
Cube-root_of_Vel  &  SQRT_Drop_Size 
with  Log.|o  transformation  “undone” 


Evap_Rate_(copy) 


'  F,  tO'-’ 

GVJ'O® 


1 1  interior  trials  fit  using  a 
4-ternn  linear  model  that  is 
physics  based 

25-3  (17.0,  37.6) 


Cube-root  of  Vel 


Cube-root_of_Vel 
-Cube-root  of  Vel 


Cube-roo=1.07 

SQRT_Dro=2.00 

Value 

Low  Limit 

High  Limit 

25.25 

16.97 

37.58 

JNOLASSIFlPD/UNLIMITPn 
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on 
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with 


LIMITED 

rsics-Based  Model 


(Response  Transformed  Back  to  Original  Scale) 


Cube-roo=2.00 

SQRT_Dro=1.00 

Value 

Low  Limit 

High  Limit 

55.11 

36.66 

82.85 

Cube-root  of  Vel 
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ipar< 


UNCLASS1E1EO/UI4LIWTED 

:rap6latioi|s  for  Empirical 


(dtu^drdtrc)  !&  IPhy^i^s^B^sed  (Linear)  Models 

(Response  Transformed  Back  to  Original  Scale) 


Evap_Rate  on 
Original  Scale 


Evap_Rate_(copy) 


Velocity_(nn/s) 

Eva  p_Rate_(co  py ) 


Evap_Rate  on 
Log^o  Scale 


Cube-root_of_Vel 
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/UNLIMITED 


^qumtiallyi^uii  Trials  in  Blocks 


Block  1 


Block  2 


Block  3 


Blocking  is  used  to  prevent  correlations  between  design  variables  and  sources  of 
variation  such  as  unknown  variables  (e.g.  blocks  run  weeks  apart)  or  differences 
among  groups  of  trials  (e.g.  each  block  associated  with  a  unique  “lot”  of  raw  material) 
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\ 

\ 

^4 

1 

trials 

in  Blocks 

Block  1  Block  2  Block  3 


90 


90 


X3 
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y  =  +  ajXj^  +  a^2  ^3^3 

Run  this  block  1st  to 

(i)  estimate  the  main  effects 

(ii)  use  center  point  to  check 
for  curvature. 


y  =  a^  +  ajXj  +  a^2  ^  ^^3 

^  ^  ^13^1^3  ^  ^23^2^3 

Run  this  block  2nd  to 

(i)  repeat  main  effects  estimate, 

(ii)  check  if  process  has  shifted 

(iii)  add  interaction  effects  to 
model  if  needed. 


y  =  a^  +  a^x^  +  a2X2  +  a^^ 

^  d.j^2^jX2  ^  ^  ^23^2^3 

+  a^jX^^  +  a2^2  ^3^3 

Run  this  block  3rd  to 

(i)  repeat  main  effects  estimate, 

(ii)  check  if  process  has  shifted 

(iii)  add  curvature  effects  to 
model  if  needed. 
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Low  Humidity  High  Humidity 


Temperature  Temperature 


Original  plan  called  for  running  all3X3X3X2  =  54  combinations  of  settings  of  Wind 
Velocity  (3  levels),  Temperature  (3  levels),  Drop  Size  (3  levels)  and  Humidity  (2  levels). 
The  10  blue  locations  are  all  that  are  needed  to  estimate  the  main  effects  which  physics- 
based  scaling  of  the  axes  showed  well-fit  the  Evaporation  Rate  data  for  HD  on  glass. 
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^gents  &  Sub^trates^tljier  than  HD  on  Glass 
,  ,Will  Likely^  Require  More  Complex  Models 


•  It  still  makes  sense  to  acquire  data  for  fitting  these 
models  as  efficiently  as  possible. 

•  Running  the  trials  in  randomized  blocks  of  trials  will 
help  to  facilitate  this  goal. 

•  Shown  below  is  a  second  block  that  when  added  to  the 
one  on  the  preceding  slide  will  support  the  4  variable 
11 -term  interaction  model. 

Low  Humidity  High  Humidity 


SORT  of  Drop  Size 


■1 

■ 

■ 

■ 

i 

Lodatidn's  bf-th^  13  Unique  Trial 
Setiii^g^  for-4h^  ^0-cm  Tunnel 


UNCLASSIFIEED/UMLIMITED 


4  extreme  (corner)  points 


1  internal  point  on  hi  T  (low  1/T)  front  face 
6  internal  points  on  intermediate  T  slice 

2  internal  points  on  low  T  (hi  1/T)  back  face 


Red  lines  indicate  the 
area  on  each  slice  of  1/T 
enclosed  by  all  points 
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SORT  of  Drop  Size 


r 


■JUNCLASSIFIED/UNLIMITED 


L( 

pcationis  of  the  1 9 

Locations  of  the  1 3 

1  i 

Ul 

|iiqu€ 

trial  settings 

unique  trial  settings 

for  the  5-cm  tunnel  for  the  lO-cm  tunnel 


1,4 


.0031 


0.0033 
0.0032  O' 


0.0034 
0.0033 


0.0032 


0031 
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ECHIP 


UNCLASSJFIED/UNLIMITED 


An  ^ffect  isithe  Change  in  the  Response 
Resulting  from  Changing  a  Variabie  Setting 

from  Low  to  Hiqh 


Results  for  the  2  tunnels  are  very  similar 


E 

CD 


Pareto  Effects  for 
Logio(Evap_Rate) 
10-cm  tunnel 


Pareto  Effects  for 

Log  ^  0  ( ) 

5-cm  tunnel 


Lack  Of  Fit 

HH 

1  Inverse  Temp 

-1.26  (-1.16,-1.36) 

hi 

3  Cube-root-Velocity  £ 

+0.53  (0.43,0.63)  o 

hi 

1 — 

2  SORT  Drop  Size 
+0.47  (0.39,0.55) 

0. 

X 

o 

LU 

1  1 

1  1 

1  lnverse_Temp 
-1.11  (-1.03,-1.19) 

3  Cube-root_of_Vel 
+0.61  (0.53,0.70) 

2  SQRT_Drop_Size 
+0.53  (0.45,  0.62) 


0.0  0.5  1.0 

Effect 


1.5 


0.0 
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0.5  1.0 

Effect 


1.5 
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E 

&_ 

0 


Hi 


W  1 

3 

2 

4 


lnverse_Temp 
-1.26  (-1.18,-1.33) 

Cube-root_of_Vel 
+0.60  (0.52,0.68) 

SQRT_Drop_Size 
+0.50  (0.43,0.57) 

Tunnel_Size 
-0.09  (-0.03,-0.15) 


0.0  0.5  1.0  1.5 

Effect 


Pareto  Effects  for 
l-ogio(Evap_Rate) 
including  tunnel  size 
(5-cni  vs.  10-cm) 


T  (Evap_Rate_(copy)) 


SORT  Drop  Size  =  2.44? 
Cube-root  of  Vel  =  1 .200 
Tunnel  Size  =  5.0 


Inverse  Temp  x  100000 


T(Evap_Rate_(copy)) 


T(Evap_Rate_(copy))  T(Evap_Rate_(copy)) 


Inverse  Temp  =  0.00324 
SORT  Drop  Size  =  2.44< 
Tunnel  Size  =  5.0 
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T(Evap_Rate_(copy)) 

Inverse  Temp  =  0.00324’ 
SORT  Drop  Size  =  2.44! 

I - 1 - 1 — ' 1 

Tunnel  Size  =  5.0 


0.6  0.7  0.8  0.9  1.0  1.1  1.2  1.3  1.4  1.5 


T(Evap_Rate_(copy)) 


SORT  Drop  Size  =  2.449 
Cube-root  of  Vel  =  1 .200 

I - 1 - 1 - 1 

Tunnel  Size  =  5.0 


Cube-root_of_Vel 


Inverse  Temp  x  100000 


T(Evap_Rate_(copy)) 


Inverse  Temp  =  0.00324 
Cube-root  of  Vel  =  1 .20C 

I - 1 - 1 - 1 

Tunnel  Size  =  5.0 


2.5 - 

2.0 

1.5— [ 
1.0 

0.5 

0. 

I 

o 

LU 

0.0 - 

5 


T(Evap_Rate_(copy)) 

- Inverse  Temp  =  0.00324 1 

SORT  Drop  Size  =  2.44t 
Cube-root  of  Vel  =  1 .200 


4  Tunnel_Size 

-0.09  (-0.03,-0.15) 


6  7  8  9  10 


\ 


SQRT_Drop_Size 


E 


Tunnel  Size 


•  Rescaling  the  variables  using  knowledge  of  the 
physics  reduces  the  complexity  of  the  model 
required  to  adequately  fit  the  data 

O  Before  rescaling,  a  10-term  quadratic  model  was  needed 

O  After  rescaling,  a  4-term  linear  model  is  all  that  is  needed 

•  Extrapolated  predictions  for  checkpoints  within  the 
5-cm  tunnel  data  validate  “nearby”  extrapolation 
with  the  physics-based  linear  model 

•  For  the  physics-based  linear  model  “farther  out” 
extrapolations  are  more  plausible  than  those  of  the 
empirical  model. 

O  Note  that  these  conditions  are  beyond  the  practical  range  of  the  wind 
tunnels  and  that  these  predictions  have  not  been  validated. 
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•  Although  the  same  level  of  reduction  of  the  number 
of  required  trials  seen  for  HD  on  glass  may  not  hold 
true  for  other  agents  and/or  substrates,  results  point 
to  importance  of  running  trials  in  a  sequence  of 
blocks  that  support  increasingly  complex  models. 

•  Combining  the  data  for  the  5-cm  and  10-cm  tunnels 
shows  that  the  “tunnel  effect”  -  although  statistically 
significant  -  is  dwarfed  by  the  effects  of  the 
Temperature,  Wind  Velocity  and  Drop  Size  which  are 
5X  to  14X  as  large.  For  HD  on  glass,  the  behavior  of 
the  two  tunnels  appears  quite  similar. 
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